Self Organized Scale-Free Networks from Merging and Regeneration 
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We consider the self organizing process of merging and regeneration of vertices in complex networks 
and demonstrate that a scale-free degree distribution emerges in a steady state of such a dynamics. 
The merging of neighbor vertices in a network may be viewed as an optimization of efficiency by 
minimizing redundancy. It is also a mechanism to shorten the distance and thus decrease signaling 
times between vertices in a complex network. Thus the merging process will in particular be relevant 
for networks where these issues related to global signaling are of concern. 
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The ubiquitous broad degree distribution of the real 
world networks has been a matter of discussions for quite 
some time (see Ref. [l]-[9]). The question as to why broad 
degree distributions are observed in so many different 
networks, has triggered various proposals for their dy- 
namical evolution. Roughly these proposals can be clas- 
sified into two main scenarios: One is related to Simon's 
model of human behavior, Ref. |lfj, and was introduced 
in a network version under the name "preferential at- 
tachment" (see Ref. ^3). A related scenario is found 
in the protein duplication model Ref. 01 which is able 
to generate broad degree distributions because duplica- 
tion, to some extent, mimics preferential attachment to 
neighboring nodes. Another class of models is where a 
scale-free distribution appears as a result of a balance 
between a modeled tendency to form hubs against an 
entropic pressure towards a random network with an ex- 
ponential degree distribution. This approach includes 
direct attempts to construct Hamiltonians (see Ref. 
H3)) local optimization approaches 0] as well as gen- 
eration of scale-free networks by balancing a threshold 
for assigning links weighted according to exponentially 
distributed binding strengths 

In this paper we are presenting a new way of obtain- 
ing the scale-free degree distributions P(k) ~ fc~ 7 . The 
proposed mechanism is associated to the phenomena of 
aggregation with injection suggested in the context of as- 
trophysical systems 0|. The model describes an evolv- 
ing network, in which the main components, represented 
by nodes, are capable of pairwise merging, while at the 
same time the size of the network is maintained by gen- 
eration of new nodes. 

In real world networks one may think of the corre- 
sponding redistribution of links as a synergetic process 
associated with an increased efficiency in the linking pat- 
tern. For example, consider the network of intercon- 
nected computers. Since the computational power of 
the computers improves tremendously fast, periodically 
it could become more favorable to replace two out-dated 
neighboring server machines with one new machine that 




FIG. 1: A schematic representation of the update rule, (a) 
A node i is chosen at random and one of its neighbors j is 
randomly picked (fcj and kj are the degrees of i and j, respec- 
tively), (b) Node m is a result of the pairwise merging with 
degree k m = (k, — 1) + (k 3 ■ — 1) + iV common , where JV co mm on 



is the number of common neighbors of i and j and the sub- 
tracted 1 is due to the lost common link. Node new is added 
with degree k new from a uniform distribution and it attaches 
links to k nem random nodes (c). 



can handle more connections. This simplifies the local 
network topology since the connections between the two 
old servers and the redundant links to other nodes are 
no longer needed. At the same time new servers may be 
constantly created to fulfill new demands. The generic 
merging or take-over process is defined by the update 
rule: 

• At each step we choose the node i with degree fcj 
randomly, and then chose one of its random neigh- 
bors j. (See Fig[IJi). 

• The nodes i and j are merged together and thus a 
node to of degree k m = (ki-l) + (kj-l)-N common 
appears instead, with N common being the number 
of nodes that are neighbors to both i and j. 

• At the same time a new node of some degree k new 
is added to the network (Fig. [IJ)) with the links 
attached to k new random nodes (see Fig|TJ;). The 
degree k new of a newly added node is a random 
number r picked from a uniform distribution with 
average (r). 
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FIG. 2: (a) The cumulative node degree distribution P(> ft) 
for networks of sizes N = 2 11 , 2 13 , 2 15 and 2 17 with the 
average (r) = 8. The fit is the power-law form P(> ft) ~ 



ft _7+1 with 7 = 2.3. (b) P(> ft) for (r) =2,4 and 8 and 
system size N = 2 14 . The straight lines are the power-law 
fit with 7 = 2.4 for (r) = 2 and 7 = 2.2 for (r) = 8. (c) 
The cumulative degree distribution P(> ft) for four different 
system sizes for the realization when two randomly selected 
nodes are merging. The fit is P(> ft) ~ fc~ 7+1 with 7 = 1.5. 
(d) P(> ft) for the merging of randomly selected nodes for 
(r) = 2,4, and 8 and system size N = 2 14 . The slope for 
every (r) is 7 = 1.5. 



Effectively this update reads: 



+ ki - N t 



common 



(i) 



where in addition the N common common neighbors are 
loosing one connection each, and r random nodes get 
one connection each. After the merging, i and j lose 
their identities and thus Eq. JJ| can equally be written 
with i and j exchanged. 

In Fig. |2Ia) we show the cumulative degree distribu- 
tions P(> k) resulting from the update rule (1), which 
is the probability of finding a vertex with degree larger 
than k, for networks of different sizes at a steady state. 
The distribution is broad, and in fact clearly exhibits a 
broad range of power-law behavior from degree of about 
k = (7-) up to a cutoff which increases with system size 
as shown in Fig. Ufa). The crucial point to note is that 
the scale- free network is an emergent property based on a 
simple merging process and that the driving mechanism 
is not related to preferential attachment. 

In order to clarify this further we first note that the 
present neighbor-merging process (see Fig. |2J) in some 
sense implicitly introduces a touch of "preferential" since, 
when taking a random neighbor of a random node, the 
neighbor is in some average sense selected with a proba- 
bility proportional to its degree. However, this touch of 
" preferential" is not an essential part of why the merging 



FIG. 3: Dynamics of the model network, with time measured 
as the number of updates per node, (a) Transient evolution 
of the maximal degree k max in the system for different system 
sizes. Notice that the y-axis is normalized with system size N. 
(b) Degree fc(t) of a given random node as a function of time 
t. When the node is merged, k(t) shows a sudden abrupt 
increase, (c) The power spectrum P(ui) versus the angular 
frequency ui obtained from the Fourier transformation of k(t). 
The fit is a power-law with exponent —2. (d) The distribution 
of changes Aft for the involved nodes in each update. 



generates scale-freeness as is illustrated by considering a 
version of the merging process where two random nodes 
are merged irrespective of whether or not they are con- 
nected, i.e. without any touch of "preferential" . In that 
case one always, independently of the value of (r), ob- 
tains a scale-free distribution P{> k) oc 1/fc 5 (see Fig. 

d). Thus it is the merging, and not the preferential 
attachment that is the primary cause of the scale-free 
distribution. In fact it is remarkable that the neighbor- 
merging produces a narrower distribution than the com- 
pletely random merging. (Compare Fig. 03 and Fig. \2p 
where 7 ~ 2.3 for the neighbor-merging and 7 = 1.5 
for the random merging.) This reflects the property of 
merging to limit growth of hubs by their absorption of 
singly connected neighbors. (See the update rule (1), if 
kj = 1 then ki — ► ki — 1.) This tendency is stronger in 
the neighbor-merging process than in the random node 
merging due to the larger probability for a hub to merge 
with a single node in the former case. It means that the 
" touch of preferential" for the neighbor-merging actually 
inhibits the growth of a hub. This is in fact opposite to 
case of " preferential attachment" where hubs are thriving 
by accumulation of neighbors of low degree. 

In the following we will discuss the original formulation 
of the mechanism Q). The main motivation being that 
the neighbor-merging version is likelier to be relevant for 
real networks since merging among the neighbors seems 
more natural than the merging of random nodes. In that 
case the only parameter in the system is the average de- 
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gree of the nodes, set by the average value of (r). In 
Fig.[3fb) we show P(> k) for three different values of (r). 
The exponent 7 in the power-law form P(> k) ~ fc~ 7+1 
decreases as one increases (r). For instance, 7 = 2.4, 
and 2.2 for (r) = 2 and 8 respectively. Furthermore we 
verified that in all cases the steady state degree distri- 
bution depends neither on the initial average degree nor 
on the shape of the initial degree distribution, be it a 
narrow distribution (star-like or exponential) or a broad 
one (scale- free). 

An additional noteworthy feature of the model is that 
it produces networks without any degree-degree correla- 
tions. We measure the correlation profile C(k\,k 2 ) = 
N(k 1 ,k 2 )/N(k 1 , k 2 ) randomised - 1, where N(ki, fca) is the 
number of edges connecting nodes with degrees ki and 
k 2 , and N(k%, ^randomised ^ s ^ ne corresponding quantity 
measured in the randomized network by many steps of 
edge exchanges (see Ref. 0] for details) . We always find 
\C(ki,k 2 )\ to be small, \C\ < O(10 _1 ), implying absence 
of significant degree-degree correlation in the networks 
emerging from the update rule QJ. 

The emergence of scaling is associated with a transient 
during which larger hubs are slowly forming, resulting in 
a self sustaining ecology with a broad degree distribution. 
This transient is illustrated in Fig.[3Ja), where we follow 
the degree of the, at any time, most connected node in the 
system. This allows us to follow the transient approach 
towards the steady state. By data collapse (not shown) 
we found that the transient time increases slightly with 
system size, oc N , whereas the maximum connected 
node at steady state has a degree, k max oc N - 3 . In 
Fig. C2h) we follow a single node in steady state for a 
N = 10 3 , and observe an intermittent behavior, which as 
seen in Fig. Etc) , can be characterized by a 1/lo 2 power 
spectrum. The power-law decay form of the power spec- 
trum indicates the absence of a characteristic time scale, 
which is in parallel with the absence of the characteristic 
degree scale in the limit of large N observed in Fig.0 We 
stress, that although the 1/ui 2 spectra resembles the one 
obtained for a random walk process, the actual dynamics 
is richer. This is reflected by the large jumps in increases 
of degree k(t) in Fig.^b). This is quantified further by 
the broad distribution of changes P(Afc) in Fig. Efd). 

So far we have been discussing a non-growing version 
of the network with the number of nodes being constant 
at each time step. One might argue that the majority 
of the real world networks are not in a steady state, but 
increase in size. For example, both the World Wide Web 
and the Internet are growing. Our merging algorithm can 
be extended to include a growth process if we add new 
nodes at each time at rate higher than that of merging. 
We stress that the growth is non-preferential in the sense 
that the newly added nodes link to the existing nodes 
with a probability that is independent of their degree. 
We start from a small initial network and grow it with 
(r) = 4 at various values of the growth rate g until the 
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FIG. 4: The cumulative degree distribution for the grow- 
ing network. Different curves correspond to different rates 
of growth. The solid curve is the degree distribution in non- 
growing case, and the line fit has slope 7 = —2.2. With 
increasing the growth rate the distribution deviates from the 
stationary distribution: For moderate growth rates (g = 0.1 
and 1) the distribution remains scale-free, whereas it collapses 
to exponential for larger growth rates (g = 10). 



network sizes reach N = 10 5 . In Fig.0]we show P(> k) 
at the growth rates 0.1, 1.0, and 10. For example, if 
the growth rate is 0.1, one vertex is added per every 
10 steps on average. If the network size increases very 
slowly, say one node per hundred basic steps, then the 
degree distribution approaches the one obtained for the 
non-growing case. As the growth rate is increased the 
distribution still retains its power-law form shape, but 
the slope 7 increases to, e.g., 2.8 for the growth rate 
1. As the growth rate is further increased, 7 reaches 
3, and then the power-law form begins to break down, 
and the degree distribution turns into the exponential 
one. The change in the slope reflects the difference in 
merging frequency and the frequency at which new nodes 
(typically nodes of low degree k ~ (fc)) are added to the 
system. In other words, the competition between the 
two time scales, one related with the merging and the 
other related with the growth, results in different degree 
distributions as the growth rate is changed. The overall 
feature is that the degree distribution becomes narrower 
at a higher growth rate because there is not enough time 
for the merging of the newly added nodes to spread across 
the whole network before the system grows further. 

We also note that the fact that the merging and the 
regeneration mechanism gives rise to scale-free distribu- 
tions does not hinge on the network structure per se. It 
is also applicable to entities characterized by just a scalar 
number, as is further discussed in |20|. 

In this Letter we propose a generic and robust mecha- 
nism for obtaining a broad, scale- free, degree distribution 
in networks where merging of nodes play a major role. 
The mechanism differs fundamentally from the preferen- 
tial attachment mechanism |2j where a broad distribu- 
tions are generated during gradual growth of hubs. The 
broad distribution resulting from merging and regenera- 
tion process emerges after a transient with slow building 
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up of a zoo of nodes of various degrees which, as the 
steady state is approached, together build up a scale-free 
distribution. We suggest that the mechanism could be 
relevant in a number of real world networks where the 
redistribution of links is associated with increasing ef- 
ficiency in the linking pattern through minimization of 
pathway lengths. As an example we suggest that merg- 
ing may be the effective result of evolution of architec- 
ture of protein regulatory networks in a cell. In these 
transcription and signalling networks, the time it takes 
to transmit signals is important |2l|. and it may thus 
be advantageous to eliminate an intermediate regulatory 
protein and move its regulation to an upstream regula- 
tory protein. With the addition of new functions in form 
of new proteins (nodes), this effectively corresponds to 
the merging and regeneration model proposed in this pa- 
per. 
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